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Abstract. We consider a generic difTusion on the ID torus and give a simple represen- 
tation formula for the large deviation rate functional of its invariant probability measure, 
in the limit of vanishing noise. Previously, this rate functional had been characterized by 
M.I. Freidlin and A.D. Wentzell as solution of a rather complex optimization problem. 
We discuss this last problem in full generality and show that it leads to our formula. 
We express the rate functional by means of a geometric transformation that, with a 
Maxwell-like construction, creates flat regions. 

We then consider piecewise deterministic Markov processes on the ID torus and show 
that the corresponding large deviation rate functional for the stationary distribution is 
obtained by applying the same transformation. Inspired by this, we prove a univer- 
sality result showing that the transformation generates viscosity solution of stationary 
Hamilton-Jacobi equation associated to any Hamiltonian H satisfying suitable weak 
conditions. 

Key words: diffusion, piecewise deterministic Markov process, invariant measure, large 
deviations, Hamilton-Jacobi equation. 
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1. Introduction 

We consider two different random dynamical systems on the one dimensional torus T 
that, in suitable regimes, can be thought of as random perturbations of deterministic 
dynamical systems. The first one is a diffusion on T, with small noise of intensity e. This 
system has an invariant distribution /x^, whose large deviation (LD) functional has been 
expressed by M.I. Preidlin and A.D. Wentzell as solution of an optimization problem |FW) . 
As discussed in |FW| . already for a very simple example of diffusion on T with velocity 
field having only three attractor points, the solution of this optimization problem requires 
a rather long procedure. 

The second system we consider is given by a piecewise deterministic Markov process 
(PDMP) on T: the state is described by a pair (x, o") € T x {0, 1}, the continuous variable x 
follows a piecewise deterministic dynamics with nonvanishing c-dependent velocity field, 
the discrete variable a evolves by an x-dependent stochastic jump dynamics and the two 
resulting evolutions are fully-coupled. When the jump rates of the discrete variable are 
multiplied by a factor A, in the limit A — )• +oo the evolution of the continuous variable x 
is well approximated by a deterministic dynamical system (cf. |FGRlj . [K]). In [FGR2], 
an expression of the probability distribution fj,^ of the continuous variable x in the steady 
state is computed up to a normalization constant. In addition, from this expression the 
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LD functional of /i is computed in the limit of diverging frequency jumps (i.e. A — )• oo). 
The resulting formula is simple and concise. 

Although the two models are not similar, we show here that the LD rate functionals for 
the measures /i^ and fi^ share a common structure. In particular they admit a very simple 
expression, that we further investigate. We then show that the optimization problem 
of M.I. Freidlin and A.D. Wentzell leads indeed to the same expression, by solving this 
optimization problem in the general case. 

For both models the rate functional is given by a geometric transformation applied to 
a specific non periodic function. The result is a periodic function, whose graph differs 
from the original one due to new flat regions. The function to be transformed is model 
dependent while the transformation is always the same. In this sense our result is universal. 
We discuss this issue in terms of Hamilton-Jacobi equations. More precisely we discuss 
the regularity properties of the functions obtained by this procedure showing that they 
are viscosity solution of a suitable class of Hamilton-Jacobi equations. 

When the models are reversible the transformation reduces to the identity. In all the 
other cases intervals on which the rate functional is constant appear. This reveals the pres- 
ence of a phase transition. This kind of stationary non equilibrium states have a physical 
relevance and have been created and studied experimentally (see for example |GPCCG] ). 

2. Models and results 

Without loss of generality, we think of T as the interval [0, 1] with identification of the 
extreme points and 1. 

2.1. Models. The first model we consider is a generic diffusion (Xf)^^^ described by 
the equation 

Xf = b{X!) + ewt, (2.1) 

where 6 : T ^ M is a Lipschitz continuous vector field, wt is a Wiener process and e is a 
positive parameter. A detailed analysis of the above diffusion, as well as of diffusions on 
generic manifolds A4, in the limit e 4- is given in |FW] . In the case A4 = T, Theorem 
4.3 in Section 6.4 of |FW| under the assumption that the closed set {x G T : b{x) = 0} 
has a finite number of connected components gives 

lim - e'^ log ^J.'' (x) = W(x) -mm W(y) , xeT, (2.2) 

£4,0 y£T 

where ^^{x)dx denotes the invariant probability measure of the diffusion (j2.ip and where 
the continuous function W is described in [FWj by a rather complex variational charac- 
terization that we recall in Section [3l The r.h.s. of (j2.2p is the LD rate functional for fi^ . 
Here and in all the paper we state our large deviations results in the simple and direct 
formulation used in (j2.2p . Of course we mean that /i^(x) is a continuous version of the 
density of the invariant measure. 

A very simple expression both of the invariant measure and of the LD rate functional 
can be given. To this aim, in the formulas below we will think of the field h{-) also as a 
periodic function on M, with periodicity 1. With this convention and without requiring 
that the set {h = 0} has a finite number of connected components, we get: 

Proposition 2.1. Define the function 5" : M ^ R as S{x) = —2 b{s)ds. Then, 

/,^(^) = _L ^e-Hsiy)-S(.)) ^ (2.3) 

c(e) Jx 
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where c(e) is the normalization constant 



c(e)= /^dx r^^e^"'(^(^)-^(^))dy. (2.4) 



Jx 

In particular, it holds 

lim — loET yU^(x) = max max (S(v') — S(x')) — max (S(v) — S(x)) 

elO 6^ ^ ^ x'€[o,i]y'e[x',x'+ir ' ye[x,x+iy- ^ ' ^ 

min {S{x)-Siy)) - min niin {S{x) - S{y')) 

j/e[x,x+l] x'G[0,l] y'e[2:',x'+l] 

Note that S{a + 1) — S{a) = — 2b{s)ds, and in particular the difference does not 
depend on a G M. Hence, given x G T, the expression Taa'Xy(z[x,x+i] {S{y) — S{x)) does not 
generate any confusion, both if we think x G T M> M by identifying T with [0, 1), and if 
we think maxj^£[a, — S{x)) as niaxj^g[^ .g+i] (^(y) — with x G M such that 

7r(x) = X, where vr : M — ?> T denotes the canonical projection. In what follows, when writing 
maXygja; [S{y) — 5'(x)) with x G T we will mean any of the above interpretations. The 
same considerations hold if we consider the minimum instead of the maximum. 

Proof of Proposition \2.1\ The proof is elementary. The fact that ()2.3p is the density of 
the invariant measure follows by a direct computation. See for example [ MNW) where a 
similar expression has been obtained. Then ()2.5p follows from ()2.3p and ()2.4p by a direct 
application of the Laplace Theorem |FWj . □ 

As a consequence of Proposition 12. H the r.h.s. of ()2.5p coincides with the r.h.s. of ()2.2p . 
where we recall that the function W is characterized as the solution of the Freidlin-Wentzell 
variational problem. This fact is not evident. The general solution of the variational 
problem determining W on the ID torus is described in detail in Theorem 14.11 which is 
stated only in Section H] after introducing some preliminaries. Its proof is given in Section 
[5] and is independent from Proposition 12. li The identification of W with the r.h.s. of ()2.5p 
is stated in Theorem 12.31 



The second model we discuss is a PDMP on the ID torus T. Let Fq,Fi : T — >■ M 
be Lipschitz continuous fields. In addition, let r(0, 1|-), r(l, 0|-) be positive continuous 
functions on T. Given the parameter A > 0, we denote by {{X^,af) : t ^ 0} the 
stochastic process with states in T x {0, 1} whose generator is given by 

La/(x, a) = F,{x) ■ V/(x, a) + \r{a, 1 - a\x) (/(x, 1 - ^r) - /(x, a)) , (2.6) 

for all (x,cj) G T X {0,1}. The above process is a generic PDMP on the torus T (cf. 
[Dj for a detailed discussion on PDMPs). Following [FGRlj . |FGR2] . we call x and a 
the mechanical and the chemical state of the system, respectively. The dynamics can be 
roughly described as follows. Given the initial state (xq, ctq) G 17 x F, consider the positive 
random variable ri with distribution 

P(ri >t)= g-^/o K^o,l-ao|xo(s))ds ^ ^ ^ Q ^ 

where xo(s) is the solution of the Cauchy problem 

X = FcTQ (x) , , _x 

x(0) = xo. ^ > 

The evolution of the system in the time interval [0, ri) is given by (xo(s),cro)- At time 
Ti the chemical state changes, i.e. a^^ = 1 — ctq, and the dynamics starts afresh from the 
state (x(ri),o"M. Note that the mechanical trajectory is continuous and piecewise . 
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Moreover, if the jump rates r(0, l\x) and r(l,0|j;) do not depend on x, then the process 
((T^ : t ^ 0) reduces to a continuous-time Markov chain with jump rates r(0, 1), r(l, 0), 
independent from {X^ : t ^ 0). In general, the chemical and the mechanical evolutions 
are fully-coupled. 

In [FGRlj (see also |FGR2j ) an averaging principle has been proved. In the limit of 
high frequency of the chemical jumps (i.e. A — > oo), the mechanical variable x behaves 
deterministically according to an ODE with a suitable averaged vector field F. In this sense 
a PDMP can be thought of as a stochastic perturbation of the deterministic dynamical 
system x = F{x). 

For simplicity, we restrict to the case of non vanishing force fields Fq,Fi. Then for each 
A > 0, there exists a unique invariant measure fl^ for the PDMP {X^^a^) and it has the 
form fx^{x,a) = fiQ{x)dx5a^Q + fl\{x)dx5(j^i, where 5 is the Kronecker delta (cf. Theorem 
(34.19), p. 118 and Theorem 3.10, p. 130 in P [Section 34] together with |F(;R2j ). Let us 
observe now the evolution of the mechanical state alone in the steady state. We set 

lX^{x)=fL^{x)+fl\{x) 

for the probability density at x of the mechanical variable in the steady state. The following 
result holds |FGR2] : 

Proposition 2.2. Suppose that Fq and Fi are Lipschitz continuous non vanishing fields 
and define the function S : M — )■ M as 



Then 



/(x) = -3- / ^'rr'V, + ^)TZ\ e^^^^y>-^^^>Jdy, (2.9) 



1 



x+l 



r(l,0|y) , r(0,l|y) 



Xs{y)-S{x)) 



Z^J, lFo{x)F^{y) F,{x)Fo{y). 
where denotes the normalization constant. In particular, it holds 

lim — — In u'^(a;) = max max (S(v') — S(x')) — max (Siy) — Six)) 

Atoo A ^ ^ ' x'e[0,l]y'&[x',x'+l]^ ^ s/G[x,x+ir ^ ' ^ " 

= min — S'(w)) — min min {S(x'\ — S(v')) . 

y&[x,x+l]^ ^ ^ ^^^^ x'emy'e[x',x'+l]^ ^ ^ " 



(2.10) 



The analogy with Proposition 12. 1 1 is evident. We refer the reader to |FGR2j for a proof 
of the above results. 

2.2. Common geometric structure of the LD functionals. We can finally describe 
the common structure behind the LD functionals of and /u^: 

Theorem 2.3. Given a continuous function F : T — )• M, define for all x 

S{x) = [ F{s)ds, (2.11) 



Jo 

<^{x) = - max {S{y) - S{x)) = min {S{x) - S{y)) . (2.12) 

yG[x,x-i'l] yG[x,x+l] 

Then the following holds: 

(i) $ is Lipschitz continuous and periodic with unit period. If S is monotone, then <I> 
is constant and equals min{0, — S'(l)}. If S{1) = 0, then S is periodic and ^ = S 
up to an additive constant. If S{1) ^ and S is not monotone, then the set 

[/ = {x G M : «>(x) / min{0, -S'(l)}} (2.13) 
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is an open subset U G M such that M\U has nonempty interior part. On each 
connected component ofU it holds ^ = S up to an additive constant, i.e. 

^{x) = S{x) - S{a) + ^{a) , yxe{a,b)cU. (2.14) 

On M \ [/ the function $ is constant and satisfies 

$(a;) = min{0,-5(l)}, Vx G M \ f7 . (2.15) 

Moreover, <I> reaches its maximum onM\U : 

max <I)(x) = max <I>(x) = min{0, -5(1)} . (2.16) 

a;G[0,oo) x€[0,l] 

(ii) Suppose that the set {x £T : F{x) = 0} has a finite number of connected compo- 
nents. Then, 

$(x) - min $(x') = W{x) - minT^(y) (2.17) 

x'e[o,i] j/eT 



where W is the function entering in ()2.2p and defined by an optimization problem 
in [FW] . taking b{x) = -F{x)/2. 

The map from 5 to <I> is the geometric transformation mentioned in the Introduction. 

Remark 1. It is interesting to observe that if we define 

/ f-y /-aj+i \ 

$(x) := inf / F^{s)ds+ / F+{s)ds) , (2.18) 

y€[x,x+l] Jy J 

then $ and $ differ by a constant. In fact, we have 

$(x) = min {S{x)-S{y))= min ( T F.{s)ds - T F+{s)ds] 

y&[x,x+l\ y<^[x,x+l\ \J ^ J 

f i-y f-x+l \ rl 

/ F_{s)ds+ j F+{s)ds\ - F+{s)ds 

Jx Jy J Jo 



mm 

y£[x,x+l] 



$(x) - / F+{s)ds. 
Jo 



Indeed, comparing with (|5.ip in Proposition 15. il one gets ^ = W under the assumptions 
of Theorem \2.S\ (ii). 

Theorem 12.31 suggests a simple algorithm to determine the graph of the function To 
avoid trivial cases, we assume that 5(1) 7^ and that S is not monotone. For simplicity 
of notation we suppose that the set {F = 0} has finite cardinality. 

• Case 5(1) > 0. We can always find a point of local maximum b such that S{b + 1) = 
maxyg[fe^^_i] S{y). This point b can be found as follows: let a G M be any point of local 
maximum for S, then let b G [a, a + 1] be such that S{b) = max^gj^ ^+1] 'S'(y). This trivially 
implies that 



s(6+i)=s(i)+sws>(^<;;+-""»*"f<'''' 

[5(1) + maxye[a,6] S[y)=T. 



maxyg[a+i^b+i] S{y) . 

The above inequalities imply that 5(6 + 1) = max^gj^ 5(y). If 6 G (a,a + 1) then 
trivially 6 is a point of local maximum for 5. Otherwise, it must be 6 = a + 1 (since 
5(a + 1) = 5(a) + 5(1) > 5(a)) and in particular b is again a point of local maximum for 
5 since a and therefore a + 1 satisfy this property. 
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The following algorithm shows how to construct the function $ on the interval [b, b+1]. 
Due to the periodicity of $ this construction extends to all M. 

Let r = {xi : 1 ^ i ^ m} be the set of points of local maximum for S in [b, 6 + 1] (note 
that 6,6+1 G r). Let Li = 5(6+1), zi = min{x G T : S{x) = Li}, and define inductively 

Lk = max{S'(x) : x GT,x < Zk-i} , = min{x S T : S{x) = L^} 

for all A; ^ 2 such that the set {5'(x) : x € F, x < 2;fc-i} is nonempty. At the end, we get n 
levels Li, . . . , L„ and points Zn < Zn-i < ■ ■ ■ < -^i, which are all points of local maximum 
for S on [6, 6+1]. In addition, it must be z„ = 6. For each i : 1 ^ i < n let j/j be the point 

Ui = max{x G [6, Zi] : S{x) = Lj+i} . 

Then the continuous function <I> on [6, 6 + 1] is obtained by the following rules. Fix the 
value ^>(6) = —5(1). Set V = U""^ [yi,Zi], then the function $ must be equal to the 
constant —5(1) on V and must satisfy V# = V5 on [6, b + 1]\V. See figure [T] 

We do not give a formal proof of the above algorithm, it can be easily obtained for 
example from the following alternative representation of the function $ when x belongs 
to the special unitary period [6, 6 + 1] 

^>(x) = min (5(x) — S{y)) = S{x) — max S{y) 

yS:[x,x+l] yG[x,x+l] 

= 5(x) - max 5(y) = 5(x) - 5(1) - max 5(y) . (2.19) 

ye[b+i,x+i] ye[b,x] 

Note that in the last term we are maximizing only over the interval [6, x]. The algorithm 
follows easily. 

The algorithm can be summarized by the following simple and intuitive procedure. 
Think of the graph of 5 in Figure [1] as a mountain profile and imagine also that light is 
arriving from the left with rays parallel to the horizontal axis. On a point x such that the 
corresponding point on the mountain profile is in the shadow we have V$ = V5. On a 
point X such that the corresponding point on the mountain profile is enlightened, we have 
V<I> = 0. Note in particular that flat intervals are always to the left of some local maxima. 
• Case 5(1) < 0. The algorithm in this case is similar to the case 5(1) > 0, it is 
enough to inverte left with right. More precisely, first one determines a point of local 
maximum 6 such that 5(6) = maxj^g[t fe+ij 5(y). One defines F as above, let Li = 5(6), 
zi = max{x € F : 5(x) = Li}, and define inductively 

Lk = max{5(x) : x S F,x > z^-i} , z^ = max{x G F : 5(x) = Lk} 

for all A; ^ 2 such that the set {5(x) : x € F, x > Zk-i} is nonempty. It must be Zn = 6+1. 
For each i : 1 ^ i < n let j/j be the point 

yi = min{x G [zi,b+ 1] : 5(x) = Lj+i} . 

Setting <I>(6) = —5(1) and V = ^^=i[zi,yi], the conclusion is the same as in the case 
5(1) >0. 

Also in this case an interpretation of the algorithm in terms of mountains and light can 
be given. The difference is that light is arriving now from the right. Note also that in this 
case fiats intervals are always located at the right of some local maxima. 

2.3. Hamilton Jacobi equations and universality. Finally, we illustrate the relation 
of the function <!• with Hamilton-Jacobi equations: 

Theorem 2.4. Given a continuous function F : T ^ M, let H{x,p), with {x,p) € T x M, 
be a Hamiltonian such that 
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= b + l 



Figure 1. Algorithm to determine the flat regions and the function <I>: 
case S{1) > 0. 



(A) H{x, •) is a convex function for any x G T, 

(B) hIx,0) = H{x,F{x)) = for any x G T. 

Then the function <I>(x) defined in Theorem \2.3\ is a viscosity solution of the Hamilton- 
Jacobi equation 

V$(x)) = 0, xeT. (2.20) 

Hypothesis (A) is a rather weak assumption since usually the Hamiltonian is obtained as 
Legendre transform of the convex Lagrangian function. Theorem 12.41 states a universality 
property: independently from the exact expression of the Hamiltonian, as soon as condi- 
tions (A) and (B) are satisfied, $ is a viscosity solution of the Hamilton-Jacobi equation 
(12:20]) . 

We recall (see [B], [CLj . [E]) that a function is a viscosity solution for the Hamilton- 
Jacobi equation H{x,'V(f{x)) = iff (/9 G C(T) and 



H{x,p)^Q \/x £T, p e D-ip{x) , 
H{x,p)i:0 \/x £T, p e D+ip{x) , 



(2.21) 
(2.22) 
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where the superdifferential D^ip{x) and the subdifferential D (p{x) are defined as 



As explained in |FWj for the diffusion and in |FGR2j for the PDMP, Hamilton-Jacobi 
equations appear in a natural way in problems related to the computation of the quasipo- 
tential. In the case of the diffusive model the associated Hamiltonian is 



It is easy to check that the Hamiltonian in (|2.25|) satisfies hypotheses (A) and (B) of 
Theorem 12. 4[ For PDMPs the corresponding Hamiltonian has a more complex structure 
and is written in |FGR2j page 298. Also in this case it is possible to check that hypotheses 
{A) and (B) are satisfied. 

2.4. Outline of the paper. In Section[3]we recall the definition of the function W given 
in |FW] . This definition consists of two optimization problems, whose detailed solution is 
described in Theorem 14. II in Section HI In Section [5] we prove Theorem 14 . 1 1 and part (ii) of 
Theorem 12.31 In Section [6] we prove part (i) of Theorem 12.31 while in Section [7| we prove 
Theorem 12.41 



For the reader's convenience and in order to set the notation for further developments, 
in this section we briefly recall the definition of the function W given in Chapter 6 of |FW) . 
It is convenient to set F{x) = —2b{x) and to work with F instead of the field b entering in 
the definition of the diffusion (|2.ip . We use the same notation of Theorem 12.31 Moreover, 
we write F- and F^ for the positive and negative part of F, respectively. This means that 
-F-_(x) = \F{x) A 0| and F^{x) = F{x) V 0. In what follows we identify the torus T with 
the ID circle and we write vr for the canonical projection tt : R ^ M/Z = T. In particular, 
the clockwise orientation of the ID circle corresponds to the orientation of the path tt{x) 
as X goes from to 1. In order to avoid confusion in the rest of the paper we will not 
identify T with the interval [0, 1). Finally, we recall that we think of F both as function on 
the torus and as periodic function on R with unit period and that, given x G T, we write 
max / minj^g[a, 3._|_i](S'(y) — S{x)) for the quantity max / miny£[^^^_|_i] — S{x)) where x 
is any point in R such that 7r(x) = x. 

Since the function S is constant on each connected component C of {x € R : F{x) = 0}, 
we denote by S{C) the constant value S{x), x € C. Recall the assumption for (|2.2|) that 
the closed set {x G T : F{x) = 0} has a finite number of connected components. We 
say that a connected component [a, b] is stable if for some e > it holds F{s) < for all 
s G [a — e,a) and F{s) > for all s S {b,b + e]. We say that [a, b] is totally unstable if for 
some e > it holds F{s) > for ah s G [a — e, a) and F{s) < for ah s G (6, 6 + e]. If 
the connected components of {x G T : F{x) = 0} are given by isolated points, then the 
stable and unstable ones are obtained by the canonical projection vr : M ^ T of the points 
of local minimum and local maximum for S, respectively. 

We call Ki,K2, . . . ,Ki the stable connected components of {x G T : F(x) = 0} labeled 
in clockwise way, i.e. Ki and .fCj+i are nearest-neighbors and -ftTj+i follows Ki clockwise. 
Moreover, for generic i G Z, we denote by Ki the component Kj, such that 1 ^ j ^ £ and 




(2.23) 



(2.24) 



H{x,p) —pip- F{x)) , (x,p)gTxR. 



(2.25) 



3. Definition of the function W given in |FW) 
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i = J in 'L/l'L. We observe that between Ki and .fCj+i (with respect to clockwise order) 
there exists only one connected component of {x G T : F{x) = 0} totally unstable. We 
call Ai such connected component. 

Given two distinct points x, y G T we write 7+^ and 7"^^ for the unoriented paths in T 
connecting x to y clockwise and anticlockwise, respectively. If x = y we set 7^3.. = 'y~^ = 
{x}. Note that 'y~y = 7+^. Given a generic function /i : T — > M the integrals h{s)ds, 
J^- h{s)ds are defined as 

h( \.i j nHs)ds if X < y, 

h{s)ds= _ (3.1) 

I [js Hs)ds \fy<x, 

and 

^^ \nKs)ds if y < X, 
Ks)ds = y,^, (3.2) 

'-fx,y \^Jy 'l-ytiJUb LI X <^ y , 

where x, y are the only elements in [0, 1) such that 7r(x) = x and 7r(y) = y. 
Given x, y S T we define 



V+{x,y) = I F+{s)ds, (3.3) 
V-{x,y) = [ F^{s)ds, (3.4) 



x,y 



Vix,y) = V+ix,y)AV-{x,y). (3.5) 

Due to Lemma 3.1 in Section 4.3 in [FW] and the discussion in Section 6.4 in |FWj . the 
above function V{x, y) coincides with the function F(x, y) defined in |FWj at page 161 
as well as our definition of stable component coincides with the one given on page 188 in 
[FW] . 

Given two distinct connected components Ci, C2 in {F = 0} C T, the quantities V{x, y), 
^±{^1 v) with X G Ci and y G C2 do not depend on the particular choice of the points x, y 
and are denoted respectively by ^(Ci, Ca), F±(Ci, Ca). We set V{Ci,Ci) = V±{Ci, Ci) = 
(note that V{x,y) = for all x,y G Ci, while due to our definition V±(x,y) typically 
depend from x,y G Ci). 

Let us now pass to define the function W . If {F = 0} = 0, then set W = When 
{F = 0} ^ then necessarily there is at least one stable connected component. If there is 
only one stable connected component, then set W{Ki) = 0. Let us now assume £ ^ 2. 

Given an index i in {1, . . . ,£}, an oriented graph g is said to belong to the family G{i} 
if it is a directed tree having vertices {1, . . . , £}, rooted at i and pointing towards the root. 
This means that 

(1) 1, . . . , £ are the vertices of g, 

(2) every point j in {1, . . . ,^} \ {1} is the initial point of exactly one arrow, 

(3) for any point j in {1, ...,£} \ {i} there exists a (unique) sequence of arrows leading 
from it to the point z, 

(4) no arrow exits from i. 

Given a graph g G G{i} the arrow from m to n is denoted by m ^ n. Then in [FWj 
the authors define 

W{Ki)= min V V{K^,Kn). (3.6) 
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Definition 3.1. The function W on T is defined in |FW] as follows: if £ = then 
W{x) = for all x gT, otherwise 

W{x) = ^ mm ^^[W{K^) + V{K^,x)] . (3.7) 
We point out that it holds W{x) = W{Ki) for ah x G Ki as discussed in |FWj . 

4. Solution of the variational problems entering in the definition of W 
Given x, y in T we define AS{x, y) as 

AS{x,y) := f F{s)ds. (4.1) 

We note that S{v) — S{u) = AS{x,y) whenever f G [n, u + 1) and x = ■K{u),y = it{v), vr 
being the canonical projection vr : R ^ T. Given C, C two distinct connected components 
of {F = 0} C T, we set AS{C, C) := 5(x, y) for any x G C, y G C". Trivially the definition 
does not depend on the choice of x, y. 

Given disjoint connected subsets A,B C T and a point x G T we write A ^ x ^ B 
X G 7^j, for some a £ A and b £ B. We write A<x^BiiA^x^B and x ^ A. 
Similarly, we define A ^ x < B and A < x < B. Then, it holds 

AS{Ki,Ai) = max{AS{x,y) : ^ x ^ y K,+i} . 

(Recall that Ai is the totally unstable connected component of {F = 0} C T between Ki 
and Ki+i.) 

We introduce some special graphs gij G G{i} with i,j G {1,...,^}. The simplest 
definition is given by Figure [2j 




9i,j 9i,i gi,i-l 



Figure 2. The graphs gij. Vertices are labeled clockwise from 1 to i. 

In order to give a formal definition, at cost of a rotation we can assume that i = 
1 ^ j ^ I. Then, gij has anticlockwise arrows j — )• j — 1, j — 1 — > j — 2,..., 2 — )• 1 and 
clockwise arrows j + 1 — )• j + 2, j + 2 — )• j + 3,..., £—^£+1 = 1. Note that if j = 1 the 
graph g has only clockwise arrows (2 — > 3, 3 — > 4,..., i — > I + 1 = 1), while if j = £ the 
graph g has only anticlockwise arrows (£—)•£ — — — 2,..., 2^1). As we will 

show, in the minimization problem ()3.6p only the graphs of the type g^j are relevant. 

We can finally state our result: 
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Theorem 4.1. The minimizers in ()3.6p and ()3.7p can be described as follows, 
(i) Take i ^ 2. Fixed i S {1, . . . take J € {1, • • • such that 

AS{Ki,Aj)= max {S{y) - S{x)) 

y€[x,x+l] 

for some (and therefore for all) x G Ki. Then 

WiKi)= Yl V{K^,Kn), (4.2) 

(m->n)e9i,j 

and for each arrow m n in gu it holds 

[y+(Km,K„,+i) ifn = m + l. 

(a) Take 1^1. Take x € T \ (u^^^^JCj.) . Take i G {1, . . . , £} such that Ki < x < i^i+i- 
Fix Xi G Ki, Xj+i G i^i+i- T/ien, ^a: G M suc/i that Xi = 7r{xi), and afterwards fix 
G {xi,Xi + 1] siic/i i/iai x = 7r{x), Xj+i = 7r(j;j_|_i). 
Then exactly one of the following cases holds: 

(1) Xi<x^Ai and max^^gj^;^ ^3.^+1] S{y) = max^gfj. ^.+1] S{y); 

(2) Xi<x^Ai and max^g[5;^^j;^+i] S{y) < maXy^.^^.^.^^ S{y); 

(3) Aii^x < Xj+i and ra^-Ky^y^^^^^^^^^^^ S{y) = mayLy^^i^^^+i] S{y); 

(4) Aii^x < Xi+i and ra&-Ky^ys:,+i,x,+^+i\ S{y) < maxj^gja;^^;^!] S{y). 
Then in cases (1) and (4) it holds 

W{x) = W{K,) + V{K^,x), V{Ki,x) = V+{K^,x), (4.4) 

while in cases (2) and (3) it holds 

W{x) = W{Ki+i) + V{Ki+y,x), V{Ki+i,x) = V.{Ki+i,x). (4.5) 



5. Proof of Theorem I2.3l fii) and Theorem 14.11 
Part (ii) of Theorem 12.31 follows easily from the following result: 
Proposition 5.1. For each x (zT it holds 

W{x) - $(x) = W{x) + max {S{y) - S{x)) = [ F+{s)ds , (5.1) 

y€lx,x+l] Jq 

In particular, the l.h.s. does not depend on x. 

We divide the proof of the above proposition in several steps. 
Lemma 5.2. Given £ ^ 2 and i,j G {1, . . . ,£}, consider 

t{i,j) := V-{Kj,Ki) + V+{Kj+i,Ki) . 

Then, 

W{Ki)= mm t{i,j). (5.2) 

Moreover, t{i,J) = mini j ^iiiih j) ^/ ^-''T'd only if 

AS{Ki,Aj)= max {S{y) - S{x)) , ^x e Ki . (5.3) 

y<^lx,x+l] 
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Proof. In order to simplify the notation, without loss of generality we take i = 1. Let us 
first show that 

W{Ki)= min V V{Km,Kn)^ min t(l,j). (5.4) 

geG{i} ^ i^j^e 

For each j G {!,...,£}, consider the graph gij G G{1} defined in Section [3l If j ^ we 
have 

i e-i 

t{l,j)^ ^ViKr,Kr^l)+ ^ V{Kr,Kr+l)= V{K^,Kn), (5.5) 

'^=2 r=j+l (rrn.n)e5i,j 

since 

j j 
V.{Kj,Ki) = Y,V-{Kr,Kr-i) > ^y(K.,i^._i), (5.6) 

r=2 r=2 

£ e 
V+{Kj+i,Ki)= V+{Kr,Kr+i)-^ y{Kr,Kr+i). (5.7) 

r=j+l r=j+l 

We point out that ()5.6p holds also for j = while ()5.7p holds also for j = 1. As a 
consequence, ()5.5p is valid also for j = 1,^ and this readily implies ()5.4p . 

Let us now prove that (j5.4p remains valid with opposite inequality. To this aim, we 
take a generic graph g G G{1} and fix x„ G Kn for each stable connected component 
Given an arrow m ^ n, we define (T(m — )• n) G { — , +} as 



a{m — 7> n) 

Note that 



+ if V^{K^,Kn) > V+{K^,Kn) , 



V{Km,Kn) = V„(r,i-^ri){Km,Kn) = / , F^Un_,n){s)ds . 

^ ' I cT(m— )-n) ^ ' 



Given (7 G G{1}, let us call 



(5.^ 



^(5) ■■= E ^ (^^- e T.!-.-:"^) , (5.9) 

(m,^n)Gg jG{l,.../}\{m,n} 

where x denotes the characteristic function (x(^) equals 1 if the condition A is satisfied 
and zero otherwise). We denote by {1} the subset of containing the elements g 

satisfying A((7) = 0, i.e. such that for any (m n) ^ g and for any j ^ m,n, it holds 

Xj ^ 7xll^x'^"'*- We next show that G*^ {1} is not empty and that we can restrict to G'' {1} 
the first minimum appearing in equation ()5.4p (we assume i > 2 otherwise this statement 

is obviously true). To this aim, if A{g) ^ 1 we fix m,n,j such that xj G 7xl™r^"^ and 
construct a new graph g' satisfying the following properties: 

(i) 5'eG{l}, 

(ii) A{g') ^ A{g) - 1, 

(hi) Eir^s)eg'yiKr.K,) ^ Eir^^)egV{Kr,K,). 

We need to distinguish two cases: 

(CI) the unique path in g from j to 1 does not contain the arrow m n, 
(C2) the unique path in g from j to 1 contains the arrow m ^ n. 
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In case (CI) the graph g' is obtained from g by removing the edge m ^ n and adding the 
edge m j. In case (C2) we call j' the arriving point of the unique arrow in g exiting 
from j (note that in this case necessarily j ^ 1), then we remove from g the arrows m —> n 
and j —?■ j' and add the arrows m ^ j and j — )• n. See Figure [3l 




Xj — X4 Xj — X4 



Figure 3. Transformation g ^ g' in cases (CI) and (C2), with m = 5, 
n = 2, j = 4 and a{m n) = —. In the above picture, we have identified 
graphs on {1, ■ ■ ■ ,1} with graphs on {xi, . . . , xi}. 

Let us now show that g' satisfies the properties (i), (ii) and (iii). 

• Proof of (i). Trivially, in all cases properties (1), (2) and (4) in the definition of G{i} 
given in Section [3] are satisfied. We focus on property (3). 

Consider first case (CI). Removing the arrow m ^ n the graph g splits into two 
connected components. One component coincides with the vertices whose unique path 
towards the root 1 in 5 contains the arrow m ^ n (in particular m belongs to this 
component), the other component coincides with the vertices whose unique path towards 
the root 1 va. g does not use the arrow m ^ n (in particular both j and n belong to this 
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component). Both components are trees. Moreover, by definition of g, the component 
containing m is oriented towards m. Likewise the other component is a directed tree 
oriented towards its root 1. If we add the arrow m — > j the graph that we obtain is 
connected and it is a tree. Using the orientations of the two merged components we easily 
obtain that it is oriented towards its root 1. 

Consider now case (C2). By arguments similar to the previous case we have the fol- 
lowing. Removing the arrows m — )• n and j — )• j' we obtain three connected components. 
One is a directed tree oriented towards its root j, one is a directed tree oriented towards 
its root m and one is a directed tree containing n and oriented towards its root 1. Adding 
the arrows m j and j — )■ n we obtain a directed tree oriented towards the root 1. See 
[BBj for the basic characterizing properties of trees that we implicitly used in the proof. 

• Proof of (ii). We first consider case (CI). We have 

A{g') = A{g) - X (x. G T^l^T^ + E ^ (^'^ ^ " 

Since it must be a{m j) = a{m — )■ n) and x„ ^ "yxln!xj''\ we conclude that 

E X {^r G 7.1™f)) ^ E ^ {^r G rJZ^T^) - 1 , (5.10) 

thus implying (ii). Let us now consider case (C2). We have 
A{g') = Aig) - ^ x{xre ^JZ^T^) - E ^ (^'^ ^ 

Again it must be a{m —?■ j) = a{m — )■ n) = a{j — )• n). Therefore the last two terms above 
equal 

E ^{^re rJZ^^) = E ^ (^^ ^ - ^ • 

This identity together with (|5.11|) leads to (ii). 

• Proof of (iii). We first consider case (CI). Then we have 

^ V{Kr,Ks)- Yl y{Kr,Ks) = V{K^,Kn)-V{K^,Kj) = 

/ , Fa{m-^n)is)ds - / (s)(is . (5.12) 

Since a{m — ?• n) = a{m j) the last difference must be nonnegative. 
In case (C2) we have 

V{K„,,Kn) + ViKj,Kj,) - ViKm, Kj) - V{K,,Kn) . 

The last difference must be positive since a{m — )• j) = a{m n) = a{j — )• n) and 
therefore ViK^,Kj) + V{Kj,Kn) = ViK^,Kn). 
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We have now proved our claim concerning the new graph g' . This claim trivially implies 
that, starting from any initial graph belonging to Gjl}, with a finite number of iterations 
of the above procedure we end with a graph belonging to {!}. In particular {1} is 
not empty. Moreover from property (iii) we have that 

min V Y(Kr,Ks)= min V YiKr.K,) 

Clearly if g G G'' {1} then it can contain only arrows of the type + 1 orr— T-r — 1. 

Moreover if it contains r — )• r + 1 then necessarily V{Kr, Kr+i) = V-^{Kr, Kr+i); if it 
contains (r — > r — 1) then necessarily V{Kr, Kr-i) = V-{Kr, Kr-i). This implies that if 
g £ G'^ {1} then g = gij for some j and moreover 

V{Kr,Ks) = t{l,j). 

Summarizing we have 



V{Kr,Ks)= min V V{Kr,Ks 



mm , 



= mill > V(Kr,K^)= min t(l, j) > min t(l,j), 

(r^s)eg 

that is (j5.4|) with the reversed inequality. 

It remains to prove the last statement in Lemma [5.2l Again, we take i = 1 for simplicity 
of notation. We fix two distinct indices j, J in {1, 2, ... , £} and we fix Uj € Aj and aj G Aj. 
If 1 ^ j < J then it holds 

V.{Kj,Kj)= [ F_{s)ds, V+{Kj+i,Kj+i)= [ F+{s)ds . 

Therefore we can write 

J) - t{l,j) = V.{Kj,Kj) - V+{Kj+i,Kj+i) = 

-j F{s)ds = -AS{aj,aj) = -AS{Aj,Aj). (5.13) 

Similarly, if J < j ^ ^, it holds t(l, J) — t{l,j) = AS{Aj,Aj). In particular, an index J 
realizes the mini ^ i ^ ^ ^(^i j) if ^^^d only if AS{Aj,Aj) ^ for all j such that 1 ^ j < J 
and AS{Aj, Aj) ^ for all j such that J < j ^ £. These inequalities read as follows: 
considering S on the interval [xq, xq + 1] such that 7r(xo) € Ki, the highest local maximum 
(and therefore the maximum) of S is attained at all points y G [xqjXq + 1] such that 
TT{y) G Aj. This coincides with the characterization ()5.3p . □ 

Remark 2. Fixed i £ {I, . . . ,£}, set 

N+ = {i G {1, . . . , n : V+{K„K,) ^ V-{K„K,)} , 
Nr = e {1, . . . : V+{Kj,K.i) > V-{K„Ki)} . 
It is simple to check that there exists a G {0, ...,/ — !} such that 

= {i — m : O^m^a}, 
Nr = {i + m : 1, ^ m ^ / - a - 1} , 
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One could ask if the index J of Lemma \5.2\ can be characterized asJ = i + l — a — I or 
J = i + 1 — a. It is easy to check that this simple characterization cannot hold by drawing 
suitable functions S. 

In what follows, in order to make the discussion more intuitive, it is convenient to use 
geometric arguments. To this aim we fix some language. We call slope of the function S its 
graph restricted to intervals I of the form / = [xi, Oi] or I = [oj, Xj+i], where Xj, Xj+i, Oj are 
points in M such that 7r(xi) € iCj, 7r(3;j+i) € Erj+i,7r(aj) E Ai and (ii — Xi < 1, Xj+i — a, < 1. 
If / = [3;j,aj], then the slope is increasing and its height is set equal to S{ai) — S{xi)] if 
/ = [ai,Xi^i], then the slope is decreasing and its height is set equals to S'(aj) — S{xi+i). 

Lemma 5.3. Identity ()5.ip holds for all x € Ki, 1 ^ i ^ i, £ ^ 1. 

Proof. If £ = 1, then the thesis is trivial. Suppose that £ ^ 2 and see Figure |H Without 
loss assume that i = 1. Fix points xi < ai < X2 < • • • < < < 2:1 + 1 such that 
7r(xj) € Kj and '/r(aj) G Aj. Take J as in Lemma [52] such that W{Ki) = t{l, J). 




Xl ai X2 0.2 X3 03 X4 04 Xl + 1 

Figure 4. Proof of Lemma [Ol with i = 1, J = 3, £ = A. The first line 
of signs illustrates how to sum slope heights to get viiaXy^[^^ xi+i]{S{y) — 
S'(xi)). The second line of signs illustrates how to sum slope heights to get 
WiKi). 

Then maXyg[2;j (S'(y) — S'(xi)) , by ()5.3p in Lemma [5121 equals the sum of the heights 
of the slopes associated to [xi, ai], [ai, X2], • • • , [x2, 02], ... , [xj, a j] with alternating signs 
+,—,+,...,+. On the other hand, by Lemma 15.21 again. W{Ki) equals the sum of 
the heights of the slopes associated to [ai, X2], . . . , [aj_i, xj] and [xj+i, aj+i], . . . , [x^, a^]. 
Hence, W{Ki) + 

T^SiX-y £[xi,xi+i] {S{y) ~ 'S'(a^i)) simply equals the sum of the heights of the 
increasing slopes in [xi,xi + 1], i.e. F-^-{s)ds. □ 

Lemma 5.4. Suppose £ ^ 1. Then, given x G T and i € {1, . . . ,£}, it holds 

W{Ki) + V±{K„x)^ ['F+{s)ds- max {S{y) - S{x)) , (5.14) 

Jo S/G[2.',2.'+l] 

where V±{Ki,x) := if x (z Ki and V±{Ki,x) := V±{xi,x) for any Xi ^ Ki if x ^ Ki. 
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Proof. If X G -fCj we have nothing to prove due to Lemma 15.31 We assume x ^ Ki and we 
fix Xi G Ki, and also x,Xi EM such that 7r(x) = x, 7r(rEj) = Xi and \x — Xi\ < 1. Then, 
substituting W{Ki) by means of Lemma [531 we get that ()5.14p reads 

V±{xi,x)^ max (^S{y) — S{xij) — rnax (^S{y) — S{x)^ . (5.15) 

yi^[xi,Xi+l] y&[x,x+l] 

We give the proof for V+(xj,x). The other case is completely similar (indeed, specular). 
We can always choose x and Xi such that Xi < x < Xi + 1. Then we can bound 



V+{xi,x) 



,-x r-y 

/ F^{s)ds ^ max / F{s)ds = max {S{y) — 5(xj)) . (5.16) 

Jxi y&[Si,x] y&[Si,x] 

Hence, to conclude it is enough to show that the last member in (|5.16p bounds from above 
the r.h.s. of (|5.15|) . This is equivalent to the inequality 

max 5(y) ^ max S{y) — max S{y) + S{x). 

ye[xi,x] ye[xi,Xi+l] y€[x,x+l] 

If the l.h.s. equals the first term in the r.h.s., then the inequality is obviously verified. 
Otherwise, it must be maxj^g[^. S{y) < maxj,g[^ S{y) and the conclusion becomes 
trivial. □ 

Lemma 5.5. Suppose £ ^ 1. Take x € T \ (u^^^-fCr) • Take i G {!,...,£} such that 
Ki < X < Ki^i. Fix Xi € Ki, Xj+i € -fCj+i (if £ = 1 take Xj = Xj+ij. Then, fix Xi such 
that Xi = vr(xi), and afterwards fix x, Xi+i G (xi,Xj + l] such that x = vr(x), Xj+i = 7r(xi+i). 

Then exactly one of the four cases (1),...,(4) mentioned in Theorem \4-l\ (H) holds. 
Moreover, in cases (1) and (4) it holds 

Vj^{Ki,x) + rnax S{y) — S{x) = max S{y) — S{xi), (5-17) 

y€lx,x+l\ yelxi,Xi+l\ 

while in cases (2) and (3) it holds 

V-{KiJ^i,x) + rnax S{y) — S{x) = _ max S{y) — S{xi^i) . (5.18) 

ye[x,x+l] j/G[Si+i,Xi+i+l] 

Proof. In case (1) it holds V+{Ki,x) = S{x) — S{xi) and the check of (|5.17|) is immediate 
(see Figure ED. Case (3) is similar. We only need to treat case (2), since case (4) is 
specular (take a reflection at the origin). To this aim, we fix Oj G (xj,Xj + 1] such 
that 7r(aj) G Ai. Then, due to the definition of case (2) (see Figure E]), it must be 
maxj^e[x,x+i] S{y) = 5'(x + 1) and maXj^gj^j^^^ .j^^^+i] S{y) = S{ai + 1). In particular, (|5.18p 
is equivalent to 

V-{K,+i,x) + S{x + 1) - S(x) = S{a^ + 1) - S{xi+i) . 

Since S{x + 1) — S{x) = S{ai + 1) — S{di) = S{1), the above identity is equivalent to 
V-{Ki+i,x) = S{ai) — S{xi+i) which is trivially true (see Figure [5]). 

It remains now to prove that the above four cases are exhaustive. Suppose for example 
that Xj ^ X < Ai. Then it is trivial to check that it cannot be max^gj^. j^.^ij S{y) > 
^aXy^[s,x+i]S{y). □ 

We can finally conclude: 

Proof of Proposition \5.1\ and Theorem \4.1\ (ii) . If ^ = 0, then by definition W = and we 
only need to prove Proposition 15.11 We take x G M such that tt{x) = x and note that the 
function S is monotone. If it is weakly increasing, then 

-1 rl 



max 

y£lx,x+l\ 



{S{y) - S{x)) = S{x + 1) - S{x) = [ F{s)ds = [ F+{s)ds 

Jo Jo 
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xi ai X2 0.2 X3 as xi + 1 ai + 1 3:2 + 1 

Figure 5. Proof of Lemma 15.51 with i = 1, i = 3. If xi < x ^ z, then case 
(1) takes place. If z < x < ai, then case (2) takes place. 

which coincides with (jS.ip . Similarly, one gets ()5.ip if S is weakly decreasing. 

Let us restrict now to £ ^ 1. If x G uf^-^Ki, we only need to prove Proposition 15. II and 
in this case the thesis coincides with Lemma 15.31 Suppose that x uf^iKi. Due to the 
definition of the function W and inequality (|5.14|) in Lemma \5A\ 

W{x)^ [ F+{s)ds- max {S{y) - S{x)) . 

Moreover, if for some j € {1, . . . ,i} and some sign a G { — , + } it holds 

W{Kj) + V^{Kj,x)= [ F+{s)ds- max {S{y) - S{x)) , (5.19) 

JO J/G[a;,a;+1] 

then it must be 

W{x) = W{Kj) + V„{Kj,x)= [ F+{s)ds- max {S{y) - S{x)) (5.20) 

and 

V{Kj,x) = V^iKj,x). (5.21) 
By Lemma 15.31 we can rewrite W{Kj) as 

W{Kj) = [ F+{s)ds - max {S{y) - S{xj)) 

where Xj S Kj. Hence (|5.19p reads 

VaiKj,x)- max {S{y) - S{xj)) = - max {S{y) - S{x)) . (5.22) 

ye[xj,Xj+l\ y<=[x,x+l] 

By Lemma |5.5| in order to fulfill ()5.22p it is enough to take j = i and u = + in cases (1) 
and (4) (see ()5.17p ). while it is enough to take j = i + 1 and o" = — in cases (2) and (3) (see 
(|5.18p ). Since as already observed ()5.19p implies both ()5.20p and (j5.2ip . this concludes 
the proof of both Proposition 15.11 and Theorem 14.11 (ii) . □ 



Proof of Theorem \2.3\ (ii). As already observed, part (ii) of Theorem 12.31 is an immediate 
consequence of Proposition 15.11 □ 
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Proof of Theorem \4.1\ (i). If we take J as in Theorem 14.11 by Lemma 15.21 it must be 
W{K,) = t{i,J)= Yl [V-{K„„KMn = m-l) + V+{Km,KMn = m + l)] 

^ V V{Krn,Kn)^ mill V V {Km, K^) = W {Ki) . (5.23) 
N 9^G{i} , 

In particular all the inequalities in the above expression must be equalities and this proves 
the first part of Theorem 14.11 

6. Proof of Theorem 12.31 part (i) 
The periodicity of <I> follows by 

ry 

$(x + 1) = min {S{x + 1) - S{y)) = min - / F{s)ds 

y€[x+l,x+2] y€lx+l,x+2] J^+i 

ry 

= min - / F{t)dt = min - / F{t)dt = $(x) . (6.1) 

y€[x+l,x+2] y(^lx,x+l] 



In the third equality we used the periodicity of F. 

Next we show that ^ is Lipschitz. Due to the periodicity of ^ it is enough to show it 
in [0,1]. The function S is Lipschitz with Lipschitz constant K := maxx^j \F{x)\. Fix 
X < y G [0, 1]. Then we have 

|$(x) - $(y)| ^ \S{x) - S{y) \ + max S{z) - max S{w) 

ZS:[x,X + l] UiG[j/,J/+1] 



max S{z) — max S{w) . (6.2) 

2:G[a;,a;+l] we[y,y+l\ 



^ K\x — y\ + 

We now estimate the second term in (|6.2p . If the maxima are achieved respectively in z* 
and w* both belonging to [x, x + l]ri[y,y + 1] = [y,x + l], then necessarily S{w*) = S{z*) 
and the second term in (|6.2p is zero. Let us suppose that S{'w*) > S{z*). Then necessarily 
w* € (x + 1, y + 1] and 

\S{w*) - S{z*)\ = S{x + 1) + S{w*) - S{z*) - S{x + 1) ^ S{w*) - S{x + 1) ^ K\x - y\ . 
The remaining case can be treated similarly. Summarizing we have 

\^{x) - ^{y)\ ^ 2K\x - y\ , 

that is ^ is Lipschitz with Lipschitz constant 2K. 

If S is monotone, then trivially it holds ^>(x) = min {0, — ^(l)} for all x G M. When 
S is periodic, maxygj^, .j,^^] S{y) does not depend on x and therefore it holds <I>(x) = 
S{x) — maXj^g[o,i] S{y). Let us suppose now that S is not monotone and it has not period 
one, i.e. that 5(1) = J^F{s)ds / 0. Similarly to our definition on the torus T, we say 
that [a, 6] C M is a totally unstable connected component of {\7S = 0} if S" is constant on 
[a, b] and there exists e > such that S{x) < S{a) for all x € [a — e,a) U {b,b + e]. Due 
to the continuity of F, the totally unstable connected components are countable and we 
enumerate them as Aj, j G J. Due to the assumption that S is not monotone, the index 
set J is nonempty. Below, we write S{Aj) for the value S{x) with x (z Aj. 
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We write = S{x) — y^sxy^[x,x+i] S{y)- Since 5(1) = S{x + 1) — S{x) ^ 0, then the 
maximum of S" on [x, x + 1] is achieved on 

j {y £ [x,x + 1] : y £ Aj for some j} U {x + 1} if S{1) > , 
[ {y € [x, X + 1] : y € Aj for some j} U {x} if S{1) < . 

Since = S{x) — S{x) and — ^(l) = S{x) — S{x + 1), if we define as in (|2.13p 

U = {x eR : ^{x) = S{x) - max / min{0, -5(1)}} , (6.3) 

y&[x,x+l] 

then for all x E C/ the maximum of 5 on [x, x + 1] is not achieved on x or x + 1 (one has 
to distinguish the cases 5(1) > and 5(1) < 0). Since $ is continuous, we get that U is 
an open subset of R. 

We define the function ^ as ^'(x) = maxj^gj^. S{y). Then, $(x) = 5(x)-^'(x). Due 
to the above observations, when x E [/ we have 

^'(x) = max 5(74,) . 

j:Ajn[x,x+l]j^(I) 

Since ^'(x) = 5(x) — ^>(x) is the sum of two continuous functions, ^' is continuous. We 
claim that 4* is constant on every connected component of U. Indeed, consider (a, b) a 
connected component of U and suppose there exist x < y in (a, 5) such that ^'(x) 7^ ^(y). 
Then the set {^'(z) : z G [x,?/]} must contain the interval [^'(x) A ^'(?/),^'(x) V ^{y)], 
in contradiction with the fact that, when x £ U, ^ takes value in the countable set 
{S{Aj) : j G J}. This concludes the proof of our claim, which is equivalent to (j2.14p . By 
definition of U, one trivially gets ()2.15p . 

Let us prove that U is nonempty and that the interior of M \ [/ is nonempty . We start 
with the second claim. The function ^ is Lipschitz and consequently it is absolutely con- 
tinuous. This implies that it is almost everywhere differentiable, its derivative is Lebesgue 
locally integrable and moreover it holds 

rb 

S/^y)dy = $(5) - ^a) , 



for any a, 6 G M. From the previous analysis we know that ^> is differentiable on U where 
it holds V<l> = V5. Recall that U is open and M\C/ is closed. If we write A for the interior 
part of M \ [/, then B := (E.\U)\A consists of a countable set of points and in particular 
has zero Lebesgue measure. If A was empty, since B has zero Lebesgue measure, we would 
conclude that M\U = Au B has zero Lebesgue measure. In particular, we would get 

= ^l)-^0)= ['v^y)dy= [ VS{y)dy= [ V5(y)dy = 5(1) (6.4) 
Jo J[o,i]nu J[o,i] 

in contradiction with the fact that 5(1) ^ 0. 

Let us show that U is also nonempty. We discuss the case 5(1) > 0. The case 5(1) < 
can be treated by similar arguments. Since 5 is not monotone, it must have local minima. 
We claim that x £ U whenever x is a local minimum point for 5. Indeed, since 5(y + 1) = 
5(y) + 5(1) for all y G M, also x + 1 is a local minimum point for 5. Since 5 is not 
flat (otherwise it would be monotone), there must be a point z £ (x,x + 1) such that 
S{z) > 5(x + 1). This implies that maXy^^^^^j^i-^ S{y) > 5(x + 1), which is equivalent to 
X £ U, since for 5(1) > the definition of U reads 

U = {x £R : ^{x) = S{x) - max 5(y) / 5(x) - 5(x + 1)}} . 

y&[x,x+l] 
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Let US finally prove ()2.16p . where only the second identity is non trivial. Due to the 
definition ()6.3p of U, it must be < min{0, —5(1)} for all x U. On the other 

hand, due to ()2.15p . <I>(x) = min{0, — /S'(l)} for all x in the nonempty set M\U. These 
considerations trivially imply ()2.16p . 



7. Proof of Theorem 12.41 
The proof of Theorem 12.41 is based on the following fact: 

Lemma 7.1. Consider a function (/9 : T — )• M that satisfies the following properties: 

a) It is continuous. 

b) There exists an open subset OCT where it is differentiable and moreover Vif{x) = 
F{x) for any x € O. 

c) On every connected component ofT\0 it is constant. 

d) Calling {o~,o'^), j £ J the countable disjoint maximal connected components of 
O, it holds F{oj) ^ and F{o'^) ^ for any j £ J. 

Then, ip is a viscosity solution of ()2.20p for any Hamiltonian H satisfying hypotheses (A) 
and (B) of Theorem\2.4\ 



Proof. We first compute the sub- and superdifferential of ip by simply assuming (a),(b),(c) 
(assuming (d) would not change much, and we prefer to make the computation only under 
(a),(b),(c) since more instructive). 

Trivially, p is differentiable at x if and only if D^ip{x) = D^ip{x) = {a} for some value 
a G M, and in this case it holds a = Vp{x). In particular, for any x G O it must be 
D~^ip{x) = D~(p{x) = {F(x)}, and similarly for any x in the interior part of T \ O it must 
be D^Lp{x) = D~(p(x) = {0}. The non trivial cases come from x = o^ . 

• If x = oj, since 'p{y) — pix) = F{z)dz for y in a small right neighborhood of x, given 
p G M it holds 

yix \y - X\ 

• li X = then, by the same argument, we get for any p G M that 

ip{y) - ip{x) - p{y - x) 
lim j j = —F[x)+p. (7.2) 

y^x \y - x\ 

• If X = oj is not an accumulation point of dO, then p is constant on a small left 
neighborhood of x and therefore 

^^ p{y)-^{x)-p{y-x) (7.3) 

tA^ \y - x\ 

• Similarly if x = is not an accumulation point of (90, then 

lim ^jy) - ^i-) - - = _p . (7.4) 

yix \y - X\ 

• If X = is an accumulation point of dO and F{oj) > 0, then for any y in a small left 
neighborhood of x it holds 

0^ip{y)-p{x) ^ r F{z)dz. (7.5) 
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Indeed, by assumption F{oj) > and therefore F is positive on a small left neighborhood 
of X. Hence, on a small left neighborhood ip is non decreasing. Moreover, a part a 
countable set of points, ip is differentiable and Vip ^ max{0, F} = F. This leads to the 
second inequality in (|7.5p . As a consequence, it holds 



^ 1- "Pjy) - y(a^) -Pjy - x) - . ^ ipjy) - ipjx) - p{y - x) 
p ^ lim sup j j ^ lim mr j j ^ — 1' [x) + p . 

ytx \y-x\ y^x \y - x\ 

(7.6) 

• If a; = o- is an accumulation point of dO and F{Oj ) < 0, by similar arguments we get 
for any y in a small left neighborhood of x that 

r F{z)dz ^ ip{y)-ip{x) ^0, 

J X 

and therefore 

jpr \ , ^1- ^{y) - - p{y - x) ip{y) - ip{x) - p{y - x) 
— r (X) + p ^ lim sup j j ^ lim mi j j ^ p . 

ytx \y-x\ y^x \y-x\ 

(7.7) 

• If a; = Oj is an accumulation point of dO and F{Oj ) = 0, we can proceed as follows. 

On a left neighborhood of x minus a countable set of points, ip is differentiable and 

S/ip{z) e {0,F{z)}. This implies that 

y ry 
\F{z)\dz ^ ip{y) - ipix) ^ / \F{z)\dz. 

J X 

Since F{x) = 0, the above bounds trivially imply that 

lim^M^^ = 0. (7.8) 

y^x y - X 

• Formulas similar to ()7.6p . ()7.7p and ()7.8p are valid if x = is an accumulation point of 
do, F(o+) > 0, F(o+) < and F(o+) = respectively 

The above computations allow us to treat the several possible cases. 

• Case 1: x = oJ = for some i,j G J. By ()7.ip and ()7.2p . ip is differentiable at x 
and moreover D~^ip[x) = D^ip{x) = {F{x)}. 

• Case 2: x = oJ for some j € J and x is not an accumulation point of dO. We claim 
that 

' D-ip{x) = [0, F{x)] , D+p{x) = if F{x) > , 

D-p{x) = , D+ip{x) = [F{x),0] , if F(x) < , 

Vifix) = D-ip{x) = D+ip{x) = {0} if F(x) = . 

Indeed, due to (|7.ip and (|7.3p we conclude that p G D^{p{x) if and only if F{x) — p ^ 
and p ^ 0, while p G D~ip{x) if and only if F[x) — p ^ and p ^ 0. Then the claim 
follows by distinguishing on the sign of F{x). 

• Case 3: x = for some j ^ J and x is not an accumulation point of dO. We claim 
that 

' D-p{x) = , D+ip{x) = [0, F(x)] , if F(x) > , 
D~ip{x) = [F{x), 0] , D+^{x) = if F(x) < , 
Vip{x) = D-ip{x) = D+ip{x) = {0} if F{x) = . 

Indeed, by ()7.2p and ()7.4p it holds: p G D^p{x) if and only if —F{x) + p ^ and —p ^ 0, 
while p G D^p{x) if and only if —F[x) + p^ and — p ^ 0. 
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• Case A: X = Oj and x G dO is an accumulation point of dO. We claim that 

'D-ip{x) C [0, F{x)] , D+ip{x) C {F{x)} if F{x) > , 

< D'ifix) C {F{x)} , D+(p{x) C [F{x),0] if < 0, 
D-ip{x) = D+ip{x) = {0} [fF{x)=0. 

Indeed, if F{x) > then, by ([73]) and fL6\i . if p G D+(p{x) then F{x) - p ^ and 
-F{x) + p ^ 0, while if p G D~if{x) then - p ^ and p ^ 0. If F(x) < 0, by 

(|7.ip and ()7.7p . if p G -D"'"(/3(x) then ^(x) — p ^ and p ^ 0, while if p G D~(p{x) then 
^(x) - p ^ and -F(x) + p ^ 0. If F(x) = then the thesis follows from and 

• Case 5: x = and x G dO is an accumulation point of dO. Similarly to Case 4, one 
obtains 

'd-^{x) C {F(x)} , D+(p{x) C [0, F(x)] if F(x) > , 

< D^ifix) C [F(x), 0] , D+(p{x) C {F(x)} if F(x) < , 
^D-V'(x) = L>+(/j(x) = {0} ifF(x)=0. 



We have now all the tools to show that is a viscosity solution of ()2.20p at every x G T, 
adding assumption (d). 

First of all we consider a point x G T such that F{x) = 0. In this case we proved 
that (p is differentiable at x and moreover Vip{x) = 0. As consequence we obtain that the 
Hamilton-Jacobi equation is satisfied at x due to the fact that D~^(p{x) = D~ip{x) = {0} 
and moreover H{x,0) = from the hypothesis (B). 

We now consider the case F{x) 7^ 0. If (/? is differentiable at x then either D^ip{x) = 
D^ip{x) = {F[x)} or D~^(p{x) = D^ip{x) = {0}. In both cases by hypothesis (B) we have 
that 99 is a viscosity solution at x. If 99 is not differentiable at x as a direct consequence of 
the previous results, the definitions and all the assumptions (a), (b), (c) and (d), we have 
that (f is a viscosity solution at x if the following implications holds: 

p G [F(x) AO,F(x) VO] ^iJ(x,p)^0, (7.9) 

and 

p G (-oo,F(x) AO] U [F(x) V0,+oo) ^ H{x,p)^0. (7.10) 

We next show that indeed ()7.9p and (|7.10p are consequences of the hypotheses (A) and 
(B). 

Let us consider first ()7.9p . Take p G [F{x) A 0, F{x) V 0], then there exists c G [0, 1] such 
that p = cO + (1 — c)F(x). From hypotheses (A) and (B) we deduce immediately 

H{x,p) ^ cH{x, 0) + (1 - c)H{x, F{x)) = . 

We discuss now ()7.10p . Take for example the case F{x) < and p G (—00, F{x)]. Consider 
an arbitrary w G (F(x), 0) and the corresponding c G (0, 1] such that F{x) = cp+ (1 — c)w. 
From hypotheses (A) and (B) we have 

= H{x,F{x)) ^ cH{x,p) + (1 - c)H{x,w) , 

and from (|7.9p we deduce 

c - 1 

H(x,p) ^ H(x,w) ^0. 

c 

The remaining cases can be treated similarly. □ 
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We can finally conclude: 

Proof of Theorem \2.4[ We only need to show that the function ^ satisfies conditions 
(a), (b), (c) and (d) of Lemma mi 

The validity of conditions {a),(b) and (c) follows directly from Theorem 12.31 with the 
identification O = U. Let us show that also condition (d) is satisfied. To this aim, we 
consider a maximal connected component {u^,uf) of U. Then by definition we have 
^{u~) = ^{uf) = min{0, -5(1)} and ^{u) < min {0,-5(1)} for any u G {u^,uf). In 
particular, for any u € (u^, uf) we can write 

> ^>('u) -min {0,-5(1)} = «>(«) -$(nr) = / F{z)dz , (7.11) 

Ju- 

> «>(u) -min {0,-5(1)} = «>(u) -$(n+) = / F{z)dz . (7.12) 

Ju+ 

Due to the continuity of F, the above expressions imply that F{u~) ^ and F{uf) ^ 0. 

□ 
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